Designing Test-beds for General Anaphora Resolution
نویسندگان
چکیده
This paper proposes a framework for evaluating coreference resolution systems, taking into account the contribution of subcomponents. Our goal is to have a way to quickly identify bottlenecks so that the development effort can focus on the weakest part of the processing chain. We describe experiments on the contribution of the module for searching potential referential expressions using two types of input, plain text and Penn Treebank-style syntactically annotated data. We propose a metric for evaluating a coreference resolution system when the set of potential referential expressions in the input is not the same as the set of potential referential expressions in the gold.
منابع مشابه
About and Around the French Enconverter and the French Deconverter
We briefly describe the French Enconverter and the French Deconverter. We discuss then a few general points concerning the possibility of designing dependency trees equivalent to UNL graphs, the treatment of the ambiguity and anaphora resolution, and the structure of the compound nodes.
متن کاملPronominal Anaphora Resolution Using a Shallow Meaning Representation of Sentences
This paper describes a knowledge-poor anaphora resolution approach based on shallow meaning representation of sentences. Within our representation, we define a new local domain which provides a powerful cue for resolving pronominal anaphora. Other information used included syntactic information, syntactic parallelism and salience weights. We collected 111 singular 3 person pronouns from open do...
متن کاملAn Extensive Evaluation of Anaphora Resolution Based Abstract Generation System
This paper presents an extensive evaluation of anaphora resolution (AR) algorithm proposed for Abstract Generation System (AGS) and discusses the metrics used to measure its performance. The evaluation exercise is conducted with the test sets chosen from different domains and the results are compared with other existing open-source Anaphora Resolution Systems (ARSs) like Mitkov’s Anaphora Resol...
متن کاملResolving "This-issue" Anaphora
We annotate and resolve a particular case of abstract anaphora, namely, thisissue anaphora. We propose a candidate ranking model for this-issue anaphora resolution that explores different issuespecific and general abstract-anaphora features. The model is not restricted to nominal or verbal antecedents; rather, it is able to identify antecedents that are arbitrary spans of text. Our results show...
متن کاملResolution of Pronominal Anaphora for Telugu Dialogues
The challenge of anaphora resolution has been taken up from long time. However, most of the work did not include for dialogues. In this paper we discuss the types of pronouns and anaphora in Telugu language and make an attempt to build a rule based pronominal anaphora resolution algorithm for human to human conversations. The model mainly consists of two parts, creating a knowledge base with a ...
متن کامل